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6) E3 Claim(s) 1.2.1 5 and 18 is/are rejected. 
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DETAILED ACTION 

1 . This action is responsive to communications of application received 09/21/2007. 

2. The disposition of the claims is as follows: claims 1-5, 7-16 and 18-19 are pending in the 
application. Claims 1, 3-5, 7-9, 15-16 and 18-19 are independent claims. Claims 6, 17 and 20 
have been cancelled. 

■ 

Claim Rejections - 35 USC § 103 

3. In view of amended claims and review of Applicant's comments, 103 rejections are 
withdrawn. 

Claim Rejections - 35 USC § 102 

4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

5. Claims 1,2, 15 and 18 are rejected under 35 U.S.C. 102(b) as being anticipated by Xiao- 
guang Lv Jie Zhou Chang-shui Zhang, "A Novel Algorithm for Rotated Human Face Detection", 
hereinafter Lv. 

A. Lv discloses claim 1, "An apparatus for detecting orientation of a face [see 'oriented' 
and/or 'orientation' throughout document, along with Figs, la&b, 3 and 4] from image data 
acquired by photographing the face [see p. 3 at 'We apply the above framework to the face 
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libraries of MIT and our lab, all of which are real-life face images captured by CCD camera.'], 
the image data being composed of a plurality of pixel data aligned in horizontal direction and 
vertical direction [see 'pixel (x, y)' on p. 2 and 'pixel(s)' throughout the rest of the document, 
wherein 'x' corresponds to horizontal direction and c y' corresponds to vertical direction], 
respectively, comprising: 

a vertical adding section for adding the respective pixel data in the vertical direction of 
the image data [see histogram throughout document, for example, but not limited to p. 2 at 'In 
order to analyze the distribution of orientations, we develop a histogram, which is constructed 
by: {see equation (3)} where a is the angle of any orientation between 0 and n 9 g(x, y) is the 
anisotropic strength of pixel (x,y) whose orientation is a. Wherein 'y' corresponds to "vertical 
direction" and summation sign £ corresponds to "adding the respective pixel data in the vertical 
direction"] ; and 

an orientation detecting section for detecting a face orientation based on a plurality of 
sum values calculated by said vertical adding section [see 'detection, detect, detectors, detecting, 
and detected' throughout document, and on p. 2 at Tor a rotated face, the orientation of principal 

« 

axis represents the face rotation status with respect to upright situation. Suppose that the input 
window contains one face, then we can take three steps as follows: 

1 . Obtain the statistical orientation feature. For each pixel in the input window, the 
orientation 9 and anisotropic strength g are calculated respectively. In order to remove the 
influence of orientation brought by small gray scale difference between pixels (for example, in 
some smooth area, due to the quantization of gray scale, the pseudo orientation may occur.), we 
only consider the pixels whose gradient magnitude exceeds a threshold. In a circular window 
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mask the orientation histogram is generated. For real implementation, a = {0,6w,6/A7><2,....,7t ~~ 
bin} ...(5) where bin is the interval of two neighboring sampling orientation. The resolution of 
orientation can be adjusted by bin. The reason we use the circular window mask is to satisfy the 
isotropic computation. 

2. Measure the symmetry of the histogram /T (a ) . We investigate the symmetry of IT (a 
) with respect to any a: a = {0,6w,Z>w><2,....,7E ~ bin}. ...(6) 

3. Determine the orientation of the principal axis. /T (a ) is symmetric with respect to p, 
the orientation of the principal axis. So the symmetry measurement on the orientation of the 
principal axis results in a small value, may be the minimum one. Since orientations of the pixels 
in the oriented organs such as eyebrows and mouth are close to the orientation orthogonal to the 
principal axis, a local peak is generated at this orientation in the histogram FT (a ) . So two 
measurements can be used — symmetry (nature in face) and peak (distribution of oriented 
pattern in face). Using both symmetry measure and local peak information, a criterion for 
determining the orientation of the principal axis is created as follows: (7) where h(a ) and sm(a ) 
, which range from 0 to 1 , denote the normalized FT (a ) and SM(a ) , respectively; wl and w2 
are weighting factors which control the relative importance of the h(a ) and sm(a ) . Then the 
orientation of the principal axis can be obtained, at which the maximum value of the OA(a) is 
acquired. See Fig.2 for an illustration on finding the orientation of the principal axis. 

3.3 Detecting with Upright Face Detector 

With orientation of symmetry axis, We apply one classical upright- face detector proposed 
in [3] to detect the "derotated" window where a face is supposed to be contained. 
So far, the rotated face is extracted.' 
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Furthermore on p. 3 at 'We apply the above framework to the face libraries of MIT and 
our lab, all of which are real-life face images captured by CCD camera. They include faces in 
different situations, such as in different lighting conditions, with beard or even with the glasses. 

In our experiment, the rotated faces, which can not be extracted by conventional upright 
face detection systems, are tested. The results are rather satisfying and the exact orientation of 
the principal axis can be detected for over 98% of the images. Some of results are illustrated in 
Fig3. The bin of the histogram FT (a ) is set to 6 degree. The weighting factor wl in Eq.(7) is set 
to 0, and the w2 is set to 0.3/]", supra [as detailed]. 

B. Per independent claims 1 5 and 1 8, these are directed to a method and computer memory 
product, respectively, for apparatus of independent claim 1, and therefore are rejected to 
independent claim 1 . 

C. Lv discloses claim 2, "The face orientation detection apparatus of claim 1, further 
comprising: 

an extracting section for extracting characteristic data of a plurality of sum values 
calculated by said vertical adding section [see extracted throughout document, for example 
section 3.3 and Fig. 3]; and 

a characteristic table storing the characteristic data in association with a plurality of face 
orientations [see 'bin 1 , wherein corresponds with 'bin', for example p. 2 bottom of second column, 
and top the p. 3 second column], 

wherein said orientation detecting section selects, from said characteristic table, a face 
orientation corresponding to the characteristic data extracted by said extracting section 
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[corresponds with p. 2, at 'the resolution of orientation can be adjusted by bin', wherein 'bin 5 
corresponds to "table"]" supra for claim 1 and [as detailed]. 



Allowable Subject Matter 

6. Claims 3-5, 7-14, 16 and 19 are allowed. 

7. The following is a statement of reasons for the indication of allowable subject matter: 
The closest related art, Kaneshiro Naoto (JP 00137788), hereinafter Naoto, provides for 

the face of the human is extracted from an image to be processed, the face candidate area is 
divided into a specific number of blocks (division patterns are shown by broken lines in (A)), 
and integral values of edge intensity in the top-bottom direction of the image are found, block by 
block. The feature quantities found for each block are collated with patterns for matching (cf. 
(B)) found by dividing the face area actually corresponding to the face of the human according to 
the division patterns and calculating edge intensity integral values for each block to evaluate the 
accuracy of the face candidate area as an area (face area) corresponding to the face of the human. 

However, Naoto does not provide for "a horizontal adding section for adding the 
respective pixel data in the horizontal direction of the image data; an eye detecting section for 
detecting an eye position in the vertical direction based on a plurality of sum values calculated by 
said horizontal adding section; an eye vicinity adding section for adding the respective pixel data 
in the vertical direction in a vicinity region of the eye position detected by said eye detecting 
section; an orientation detecting section for detecting a face orientation based on a plurality of 
sum values calculated by said eye vicinity adding section" as claimed in independent claims 3-5, 
16 and 19. 
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Nor does Naoto disclose in addition "a vertical adding section for adding the respective 
pixel data in the vertical direction of the image data; a variation calculating section for 
calculating a variation in the horizontal direction of the sum values calculated by said vertical 
adding section; and a specifying section for specifying a face outline in the horizontal direction 
based on the variation calculated by said variation calculating section, wherein said region 
detecting section detecting the face region based on the face outline specified by said specifying 
section" as claimed by independent claim 7. Nor disclose "pixel number storing section for 
storing a predetermined number of pixels; a horizontal adding section for adding the respective 
pixel data in the horizontal direction of the image data; an eye detecting section for detecting an 
eye position in the vertical direction based on a plurality of sum values calculated by said 
horizontal adding section; an under eye adding section for adding the pixel data in the vertical 
direction in a region located lower than the eye position detected by said eye detecting section by 
the number of pixels stored in said pixel number storing section; and a local minimum value 
specifying section for specifying a local minimum value of the sum values calculated by said 
under eye adding section, said nose detecting section detecting that a position in the horizontal 
direction of the sum value specified as the local minimum value by said local minimum value 
specifying section is the nose position" as claimed in independent claim 9. 

Therefore as claimed by the combined elements of independent claims 3-5, 7-9, 16 and 
1 9, the cited references and prior art of record lack separately and in combination the elements of 
said independent claims. Claims 10-14 depend from allowable independent claims 7-9 and 
therefore are also allowed. 



r 
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Responses 

8. Responses to this action should be mailed to: Commissioner of Patents and Trademarks, 
Washington, D.C. 20231. 

Inquiries 

9. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Gregory F. Cunningham whose telephone number is (571) 272- 



If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Matt Bella can be reached on (571) 272-7778. The Central FAX Number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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